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ABSTRACT 

This case study examined which outcomes stakeho lders 
desire for Bachelor of Information Technology (BIT) degree graduates 
at Swinburne University of Technology (SUT) in Australia and whether 
they find these outcomes among graduates. The four stakeholder groups 
were current BIT undergraduates, BIT graduates, academic staff of SUT 
involved with the BIT Program, and employers of BIT graduates. Of 351 
questionnaires mailed out, 167 were returned. Among the findings were 
the following: (1) all stakeholders rated team skills, listening 
skills, and proficiency in solving workplace problems as highly 
important; (2) all stakeholders also agreed that preparation for 
further postgraduate study, specialist training, and understanding of 
mathematical disciplines were low priorities; (3) BIT students rated 
writing ability significantly lower than academic staff or employers 
did; (4) academic staff rated student accomplishment in logical 
thinking, listening skills, self-discipline, and independence lower 
than students rated themselves in these skills; (5) in most instances 
employers rated graduate accomplishment higher than academic staff 
did. Includes four tables and four figures which detail study 
findings. (JB) 
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ABSTRACT 



The Australian Higher Education Council's recent document on the Quality of Higher Education, 
inter alia, identifies the acquisition of generic skills as an important outcome for graduates. This 
case study examines the general outcomes regarded by various stakeholders to be important for 
students to achieve within a Bachelor of Information Technology degree, as well as the extent to 
which the graduates are perceived as having achieved those potential outcomes. 
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1. INTRODUCTION 



The current Australian Government's concern for quality was triggered by public disquiet about 
the deteriorating state of Australian tertiary education (Lindsay, 1992). This public perception of 
the tertiary education environment, which had occurred earlier in the USA can be attributed to 
several factors. These include the trend towards mass tertiary education, a dramatic increase in 
demand for tertiary places as a consequence of a high retention rate of year 12 students, economic 
rationalism, and the demand for accountability in public affairs in difficult economic times. 

In October 1991, the Australian Higher Education Council (HEC) was requested to recommend 
policy initiatives to enhance quality in higher education by the Minister for Higher Education and 
Employment Services. The HEC, following a series of consultations with key peak members in 
the higher education sector, released a Draft Advice document on The Quality of Hig her 
Education in July 1992 for comment and further input from the interested parties. Inter alia, this 
report resulted in the estabLshment of a national committee, the Committee for Quality Assurance 
in Higher Education (CQAHE). On 8 March 1994, the Australian Federal Minister for 
Employment, Education and Training endorsed the recommendations emanating from the 
CQAHE's first national quality review audit. All Australian universities received some of the 
$76.8 million quality funds committed by the Australian Government since "the Australian higher 
education system is made up of a diverse range of institutions, all of which are striving for 
excellence within the context of their mission and goals"(Crean, 1994) 
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2. THE PRESENT STUDY 

The aforementioned HEC document identified generic skills as being an important attribute of 
Australian graduates. Generic skills are defined as being those attributes which all graduates 
should acquire from their respective institutions irrespective of their discipline or field of study, 
including learning skills, effective communication, logical and lateral thinking and so on. The 
attributes are distinguished by the HEC from two others, namely, discipline related bodies of 
knowledge and professional/technical or job related skills. 

The purpose of this study was to explore what general outcomes the various stakeholders 
believed to be important for students to achieve within the Bachelor of Information Technology 
(BIT) Degree offered at Swinburne University of Technology, as well as the extent to which the 
students had achieved those potential outcomes. Underlying this overall purpose, the study aimed 
to indicate (a) the similarities and differences in educational priorities between the stakeholder 
respondents, (b) the issues to be addressed based on stakeholder perceptions and (c) the extent to 
which stakeholder perceived priorities are being achieved by students. 

In order to fulfill the aims of the study, data on stakeholder perceptions of the relative importance 
of the various generic skills relating to the BIT program were gathe;ed from a structured 
questionnaire entitled the BIT Student Potential Outcome Survey, which was administered to 
stakeholder respondents. The questionnaire was the outcome of a pilot survey undertaken in late 
1992 to investigate the relative importance of the various generic skills that students should 
acquire from their university study as perceived by students, staff and employers. The experiences 
gained from this pilot study (for details of the study, please refer to the 1992 and 1993 AAIR 
conference papers of the authors of this report) were utilised in developing the survey instrument 
of this study. The first section of the questionnaire for the present study related to the personal 
details of the stakeholder (or the respondent). The second section consisted of two parts 
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containing 34 Likert-type items, each measured on a five-point scale. Part A dealt with the 
estimate of importance of possible outcomes for BIT students while Part B related to the extent 
to which the respective stakeholders perceived Swinburne BIT students typically as having 
achieved the potential outcomes at the end of the program. 

Owing to the scale of the task in trying to gauge the perception of all the stakeholders concerned, 
this project limited its scope to examining the responses of four stakeholder groups, namely, the 
current BIT undergraduates, the BIT graduates, the academic staff of SUT who are involved in 
the BIT Program and the employers of BIT graduates. 



Universal sampling was applied so as to cast a wide net to catch as many of the targeted 
stakeholders as possible. This is also appropriate for a mail survey in which returns are expected 
to be lower than interview schedules. A total of 351 questionnaires were mailed to the four 
stakeholder groups in mid 1993, namely, 1 15 to the graduates, 102 to the current undergraduates, 
35 to the academic staff, and 99 tc the employers. Out of this total, 167 or 48 per cent of the 
questionnaires were returned completed, and the response varied according to stakeholder group. 
Of the four stakeholder groups, only academic staff approached a full response rate. The other 
three stakeholder groups, however, are comparable at around 40% each, which is a very 
acceptable response rate for such postal surveys. 

3. PERCEPTIONS OF STAKEHOLDERS OF GENERIC SKILLS 

Tables of results are presented to give the full detail of the findings (see attached), but with such a 
complex and rich data set, only major points can be discussed with reasonable brevity in order to 
illustrate the potential of the methodology for addressing issues of quality within a higher 
education setting. The tables present mean ratings by stakeholders of either perceived importance 
of outcomes or level of accomplishment among BIT students for each of the 34 generic skills. 
The numbers represent responses on a 5-point scale as follows: 1 = Not important/accomplished 
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at all; 2 = slightly important/accomplished; 3 = Moderately important/accomplished; 4 = Quite 
important/accomplished; 5 = Very important/accomplished. In each table, the question number 
precedes a shortened version of the actual questionnaire item. 

Perceived Importance of Generic Skills to Stakeholder Groups 

Table 3.1 shows the mean ratings by BIT students, graduates, academic staff and employers of the 
importance of each of the 34 potential generic skills outcomes presented in the BIT Student 
Potential Outcome Survey and indicates the statistically significant differences between groups, 
using two-tailed t tests. 

It can be seen from Tables 3.2 and 3.3 that there are both similarities and differences between the 
stakeholders' perceived priorities in terms of generic skills. In terms of similarities, there is a 
pleasing unanimity, for example, that team skills, listening skills and proficiency in solving 
workplace problems are highly important generic skills. Apart from one statistically significant- 
difference between BIT students and graduates shown in Table 3.1 in respect of solving 
workplace problems (with graduates rating the skill higher than current students), there are no 
statistically significant differences between the stakeholders in their rsting of the importance of 
these skills. Within the logic of this comparative approach, this could be taken as an indicator of 
BIT quality, with all stakeholders pulling in the same direction. 

Equally, there is a large degree of unanimity at the other end of the priority ranking. Tables 3.1, 
3.2 and 3.3 show that the stakeholders here agree that preparation for further postgraduate study 
or specialist training and understanding and appreciation of mathematical disciplines are relatively 
low priorities, as are the generation of wealth in commerce or industry and the capacity to 
contribute to the development of the community. The unanimity on the latter two aspects, 
however, raises other issues about which one may n-'y speculate. The government and the 
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community are also stakeholders in higher education, and they might believe that wealth 
generation and contribution to the community should be high priorities. Presumably no individual 
course can satisfy all possible stakeholders, however, and one must look to the higher education 
system as a whole for the satisfaction of the interests of what might be termed the "generic 
stakeholders", such as the government and the community, as opposed to the "specific 
stakeholders" examined here. It is interesting to note in Table 3.1, nonetheless, that BIT students 
and graduates rate the generation of wealth in commerce and industry significantly higher in 
importance than either academic staff or employers, indicating perhaps a generational shift in 
priorities. This would be consistent with general observations about the more materialistic 
campus ethos of the present compared to the allegedly more idealistic ethos of, say, the 1960s, 
albeit in very different economic circumstances. 



So far so good. What about the differences, however? BIT students rate the ability to write well 
significantly lower than either academic staff or employers. This accords well with coalface 
experience in higher education where students commonly complain that lecturers spend too much 
time criticising their English syntax, grammar and spelling in written work instead of 
concentrating on "substantive issues", as if the two were separable. This could be taken as an 
indicator of an area for future attention in the Swinburne BIT in terms of improving quality. If 
students do not fully realise the importance of the generic skill of writing well, then they are more 
likely to neglect its development. BIT staff could therefore profitably give attention to specifically 
and explicitly making students more aware of the significance of this generic skill as a first step 
enhancing it. In fact, this is likely to be a very general probbm extending right across the 
spectrum of higher education as more and more specialised courses have become the 
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Generic Skill Accomplishment of BIT Students as Perceived by Stakeholder Groups 

Table 3.4 shows the mean ratings by the BIT stakeholders of the degree of accomplishment by 
BIT students/graduates in the various generic skills presented in the BIT Student Potential 
Outcome Survey and indicates the statistically significant differences between groups, using two- 
tailed t tests. As Table 3.4 shows, there is a more extensive and marked set of differences 
between stakeholders in respect of their views of the accomplishment of BIT students/graduates 
than was the case in terms of their views of the relative importance of the generic skills outcomes. 

Table 3.4 indicates that academic staff rate the accomplishment of BIT students lower than 
students rate themselves in the following skills: 

• capacity to think logically 

• ability to resolve interpersonal conflicts 

• development of personal and ethical values 

• sensitivity to others' problems and difficulties 

• understanding of social and behavioural sciences 

• awareness of consequences of new technology 

• ability to listen to people carefully 

• self-discipline 

• capacity to work with minimum supervision. 

The skills printed in bold are those which staff have rated at a mean value of 4.00 or above, 
indicating a high degree of consensus among them that they are particularly important. This could 
mean that staff are being idealistic in their standards or that students are tending to overrate their 
abilities or a little of both. In any event, skills which are rated so highly in importance by staff and 
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yet fall somewhat short in accomplishment by their own estimation ought to be the focus of some 
consideration in terms of quality improvement by the Swinburne BIT staff. 

On the other hand, Table 3.4 also indicates that staff rate the accomplishment of BIT students 
significantly higher than students rate themselves in the following skills: 

• competence to speak well in public 

• self-confidence 

• ability to earn a good salary 

• ability to generate wealth in commerce or industry 

Although these skills are not among the highest rated for importance by staff, the first two are 
among the most important for students. The explanation which most readily suggests itself is the 
anxiety which young people so often have about getting things right and not making gaffes in 
front of others. 

Employers rate the accomplishment of BIT students/graduates lower than graduates rate 
themselves in the following skills: 

• preparation for further postgraduate study 

• ability to resolve interpersonal conflicts 

• ability to listen to people carefully 

• ability to plan 

• self-discipline 

• ability to manage time 

• capacity to work with minimum supervision. 



ERIC 



r»622i 

•-- n 



Page 9 



The skills printed in bold are those which employers have rated at a mean value of 4.00 or above, 
indicating a high degree of consensus among them that they are particularly important. Following 
the logic used above, one would also say that perhaps these areas might usefully be the focus of 
some consideration in terms of quality improvement by the Swinburne BIT staff and by employers 
in terms of staff development and training. On the latter point, one must be realistic about what it 
is possible to achieve within the time-span and the curriculum span of any given course. This 
inevitably means that (a) no given course can produce all possible desirable outcomes to optimum 
level and (b) stakeholders must share responsibility for eventual outcomes. 

There are some differences in the perceived accomplishment of BIT students between academic 
staff and employers. Here the differences are more numerous than in th^ir estimation of the 
importance of generic skills. Happily, however, the employers rate the accomplishment of the 
students/graduates more highly than the academic staff in most instances. In view of the 
foregoing considerations these differences will not b-j considered further in the paper. 



4. 



CONCLUSION 



in conclusion, the Swinburne BIT program emerges form this examination of its performance in 
terms of generic skills enhancement very well indeed, and probably better than most specialist, 
technical programs at this level. It is clear that considerable attention has been directed to the 
development of some generic skills in ways that fall outside the normal ambit of most university 
courses, and this has been possible because of the very favourable resource base of the program 
and its strong industry links. Inevitably, given the recent emergence of generic skills enhancement 
as a specific and explicit goal of Australian higher education programs, rather than a general and 
implicit goal, there is room for improvement in some areas and that process may be assisted by a 
consideration of the detail of this analysis. One must note, however, that the course is intensive 
and the strains of that intensity are evident in some of the stakeholder responses detailed here. In 
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other words, the solution to improvement does not just lie in providing more of some existing 
elements or in introducing new elements, but in a realistic and careful consideration of generic 
skills priorities and in focusing explicitly on the enhancement of some skills while necessarily 
leaving others aside for another time and/or another place. No program can do everything. 
However, by targeting specific generic skills goals within the curriculum, the BIT program will 
have a means of arriving at fair and reasonable periodical assessments of its quality in this area. 
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